Infinite-product Markov processes
نویسندگان
چکیده
منابع مشابه
ON THE INFINITE ORDER MARKOV PROCESSES
The notion of infinite order Markov process is introduced and the Markov property of the flow of information is established.
متن کاملon the infinite order markov processes
the notion of infinite order markov process is introduced and the markov property of the flow of information is established.
متن کاملMarkov processes with product-form stationary distribution
This research has been inspired by several papers on processes with inert drift [5, 6, 4, 3, 1]. The model involves a “particle” X and an “inert drift” L, neither of which is a Markov process by itself, but the vector process (X, L) is Markov. It turns out that for a number of diffusions with inert drift, the stationary measure has the product form; see [1]. The purpose of this note is to chara...
متن کاملAverage Optimality in Nonhomogeneous Infinite Horizon Markov Decision Processes
We consider a nonhomogeneous stochastic infinite horizon optimization problem whose objective is to minimize the overall average cost per-period of an infinite sequence of actions (average optimality). Optimal solutions to such problems will in general be non-stationary. Moreover, a solution which initially makes poor decisions, and then selects wisely thereafter, can be average optimal. Howeve...
متن کاملETAQA Solutions for Infinite Markov Processes with Repetitive Structure
We describe the ETAQA approach for the exact analysis of M/G/1 and GI/M/1-type processes, and their intersection, i.e., quasi-birth-death processes. ETAQA exploits the repetitive structure of the infinite portion of the chain and derives a finite system of linear equations. In contrast to the classic techniques for the solution of such systems, the solution of this finite linear system does not...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Transactions of the American Mathematical Society
سال: 1968
ISSN: 0002-9947
DOI: 10.1090/s0002-9947-1968-0217873-4